
United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 

Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 



FILING DATE 



FIRST NAMED INVENTOR 



ATTORNEY DOCKET NO 



CONFIRMATION NO. 



09/893,396 



1200 



06/28/2001 



Henry M. D'Souza 



7590 



12/29/2004 



AKIN, GUMP, STRAUSS, HAUER & FELD 
1111 LOUISIANA STREET 
44TH FLOOR 
HOUSTON, TX 77002 



H052617.1083US0 



6001 



EXAMINER 



YANG, RYAN R 



ART UNIT 



PAPER NUMBER 



2672 

DATE MAILED: 12/29/2004 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO-90C (Rev. 10/03) 



Office Action Summary 



Application No. 

09/893,396 


Applicant(s) ^1^^ 
D'SOUZA ET AL / 


Examiner 

Ryan R Yang 


Art Unit 

2672 





- Tho MAILING DATE of this communication appears on the cover shoot with the correspondence address - 
Period for Reply 
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DETAILED ACTION 



1 . This action is responsive to communications: Amendment, filed on 8/23/2004. 
This action is final. 

2. Claims 1-3, 5-11, 13-17 and 19-25 are pending in this application. Claims 1, 8, 15 
and 20 are independent claims. In the Amendment, filed on 8/23/2004, claim 20 was 
amended, and claim 22 was canceled. 

3. The present title of the invention is "Hardware-based accelerated color correction 
filtering system" as filed originally. 



4. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

5. Claims 15 and 19 are rejected under 35 U.S.C. 102(e) as being anticipated by 
Ijntema et al. (6,285,350). 

6. As per claim 15, Ijntema et al., hereinafter Ijntema, discloses a hardware- 
implemented method of color video data correction filtering, comprising the steps of: 

gamma decompensating input color video data referenced to a non-linear color 
space ("To fully compensate the color errors, the RGB signals have to be linearized by 
compensating for the gamma correction applied in the camera", column 2, line 31-33); 

compensating for color point data of a plurality of constituent colors of a color 
monitor by applying a plurality of pre-calculated gamut shifting arrays to the color point 
data, each of the plurality of pre-calculated gamut shifting arrays corresponding to a 



Claim Rejections - 35 USC § 102 
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multiplication look-up table (MLUT) comprising pre-calculated values that represent 
specific multiplication operations ("a transformation of the RGB signals with a 3x3 matrix 
can be done", column 2, line 34, since a matrix operation includes both multiplication 
and addition operations, it represents a specific multiplication operation); and 

compensating the color point data after application of the plurality of pre- 
calculated gamut shifting arrays for non-linearities of the color monitor by applying a 
plurality of non-linearization tables to the color point data to produce output color video 
data compensated for non-linearities and color points of the color monitor ("Finally, the 
gamma correction has to be applied again", column 2, line 36; "The characteristics 
could be stored in a LUT", column 2, line 59). 

7. As per claim 1 9, Ijntema demonstrated all the elements as applied to the 
rejection of independent claim 15, supra, and further discloses each of the steps of 
gamma decompensating, compensating using the plurality of pre-calculated gamut 
shifting arrays and compensating using the plurality of non-linearization tables is 
performed at a substantially full video rate (since the LUT table is used instead of 
multiplication operations, the gamut shifting arrays is performed at the full processing 
speed of the graphics controller). 

Claim Rejections - 35 USC § 103 

8. Claims 20-21 and 23-25 is rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Oku et al. (5,489,996). 
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As per claim 20, Oku et al, hereinafter Oku, discloses a color correction system, 
comprising: 

a color filter that receives image data and produces color video data (Figure 5 37 
the First Color Correction Unit is considered a color filter because it "normalizes input 
image signals and converts them to the data signals in a region suitable for the color 
adjustment for the input image signals, and makes the color adjustment", column 6, line 
59-62); 

a color point correction system that receives the color video data and produces 
color point corrected video data (Figure 5 44 the 2 nd Color Correction Unit); and 

a non-linearity correction system that receives the color point corrected video 
data an produces non-linearity corrected video data (Figure 5 48 3 rd Color Correction 
Unit which compensates for the non-uniformity of recording materials), wherein the color 
point correction system comprises a plurality of multiplication look-up tables (MLUTs) 
associated with a plurality of pre-calculated gamut shifting arrays to compensate for 
color point data ("The input data normalizing unit 56 receives the image data from the 
host computer, and converts them into R, G, and B data each consisting of eight bits, 
through gradation converting tables LUT1-1 61, LUT1-2 62, and LUT1-3 63", column 7, 
line 33-37; "The color adjustment unit 57 matrix-calculates the output data Ri (58), Gi 
(59), and Bi (60), thereby to execute the color adjustment", column 8, line 1-3, where 
the matrix operation has multiplication process, therefore, the LUT Is a MLUT). 

Oku discloses a color correcting system. It is noted that Oku does not explicitly 
disclose compensation for color point data is at substantially full video rate, however, 
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since processing data near full video rate is desirable for viewing video in real time, it 
would have been obvious to one ordinary skill in the art to try to do so in order to view 
the video in real time. 

9. As per claim 21 , Oku demonstrated all the elements as applied to the rejection of 
independent claim 20, supra, and further discloses the color filter decompensates for 
non-linear RGB input based on a standard color image gamma function (column 7 - 
column 8, equation 9). 

10. As per claim 23, Oku demonstrated all the elements as applied to the rejection of 
independent claim 20, supra, and further discloses each of the plurality of MLUTs are 
loaded with pre-calculated values that represent specific multiplication operations ("The 
hardware of the first color correction unit may be constructed as shown in FIG. 9. As 
shown, the three look-up tables 61 , 62 and 63 of the input normalizing unit and the 
linear matrix calculator 57 are constructed with a total of nine look-up tables 64 60 72 
and three adders 3, 74 and 75", column 9, line 25-30, since a matrix operation in a 
linear matrix calculator includes both multiplication and addition operations, it represents 
a specific multiplication operation. 

11. As per claim 24, Oku demonstrated all the elements as applied to the rejection of 
independent claim 20, supra, and further discloses each of the plurality of MLUTs 
comprises pre-calculated RGB component outputs for each of 256 intensities of each 
primary color ("the calculated R data is further converted in accordance with formula 
(10) below so that the converted data always maintains the 256 gradations", column 9, 
line 39-41). 
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12. As per claim 25, Oku demonstrated all the elements as applied to the rejection of 
independent claim 20, supra, and further discloses the non-linearity correction system 
comprises a set of non-linearization color look-up tables (CLUTs) ("The output 
characteristic correction LUT 75 is mainly used for compensating for manufacturing 
variations in the apparatus and in the recording medium used", column 14, line 32-34, 
since the variation due to manufacturing is inherently non-linear, the tables generated to 
compensate it is inherently non-linear). 

13. Claims 1-2, 5, 7-9, 14 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Ijntema et al. (6,285,350) and further in view of Oku et al. (5,489,996). 

As per claim 1, Ijntema et al., hereinafter Ijntema, discloses a hardware- 
implemented color video data correction filtering system, comprising: 

a plurality of linearization tables to gamma decompensate input color video data 
referenced to a non-linear color space ("To fully compensate the color errors, the RGB 
signals have to be linearized by compensating for the gamma correction applied in the 
camera", column 2, line 31-34; "The characteristics could be stored in a LUT", column 2, 
line 59); 

a plurality of a set of pre-calculated gamut shifting arrays to compensate for color 
point data of a plurality of constituent colors of a color monitor with each set of pre- 
calculated gamut shifting arrays corresponding to a multiplication look-up table (MLUT) 
comprising pre-calculated values that represent specific multiplication operations, each 
set of pre-calculated gamut shifting arrays coupled to one linearization table of the 
plurality of linearization tables ("a transformation of the RGB signals with a 3x3 matrix 
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can be done", column 2, line 34, since a matrix operation includes both multiplication 
and addition operations, it represents a specific multiplication operation); 

and a plurality of non-linearization tables coupled to the plurality of hardware 
adders to compensate for non-linearities of the color monitor and produce output color 
video data compensated for non-linearities and color points of the color monitor 
("Finally, the gamma correction has to be applied again", column 2, line 36; "The 
characteristics could be stored in a LUT", column 2, line 59). 

Ijntema discloses a color correction system. Ijntema further discloses a matrix for 
compensating color. It is noted that Ijntema does not explicitly disclose a plurality of 
shifting array and hardware adders coupled to one of the pre-calculated shifting arrays, 
however, this is known in the art as taught by Oku. Oku discloses a color correcting 
system in which the color adjusting matrix is built with a plurality of look-up tables and 
adders ("The hardware of the first color correction unit may be constructed as shown in 
FIG. 9. As shown, the three look-up tables 61 , 62 and 63 of the input normalizing unit 
and the linear matrix calculator 57 are constructed with a total of nine look-up tables 64 
60 72 and three adders 3, 74 and 75", column 9, line 25-30). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Oku into Ijntema because Ijntema 
discloses a system for color correction with matrix for color compensation and Oku 
discloses the matrix used for color compensation can be constructed with a plurality of 
look-up table and adders in order to accelerate the processing speed. 
14. As per claim 8, Ijntema discloses a computer system, comprising: 
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a processor (Figure 1 C); 

video memory coupled to the processor (since LUT could be used in digital 
implementation (column 2, line 55-60), it is inherent that memory is used to store LUT); 
and 

a color video data correction filtering system coupled to the processor, the 
system comprising: 

a plurality of linearization tables to gamma decompensate input color video data 
referenced to a non-linear color space ("To fully compensate the color errors, the RGB 
signals have to be linearized by compensating for the gamma correction applied in the 
camera", column 2, line 31-34; "The characteristics could be stored in a LUT", column 2, 
line 59); 

a plurality of a set of pre-calculated gamut shifting arrays to compensate for color 
point data of a plurality of constituent colors of a color monitor with each of the plurality 
of pre-calculated gamut shifting arrays corresponding to a multiplication look-up table 
(MLUT) comprising pre-calculated values that represent specific multiplication 
operations, each set of pre-calculated gamut shifting arrays coupled to one linearization 
table of the plurality of linearization tables ("a transformation of the RGB signals with a 
3x3 matrix can be done", column 2, line 34, since a matrix operation includes both 
multiplication and addition operations, it represents a specific multiplication operation); 

a plurality of non-linearization tables coupled to the plurality of hardware adders 
to compensate for non-linearities of the color monitor and produce output color video 
data compensated for non-linearities and color point of the color monitor ("Finally, the 
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gamma correction has to be applied again", column 2, line 36; "The characteristics 
could be stored in a LUT", column 2, line 59). 

Ijntema discloses a color correction system. Ijntema further discloses a matrix for 
compensating color. It is noted that Ijntema does not explicitly disclose a plurality of 
shifting array and hardware adders coupled to one of the pre-calculated shifting arrays, 
however, this is known in the art as taught by Oku et al., hereinafter Oku. Oku discloses 
a color correcting system in which the color adjusting matrix is built with a plurality of 
look-up tables and adders ("The hardware of the first color correction unit may be 
constructed as shown in FIG. 9. As shown, the three look-up tables 61 , 62 and 63 of the 
input normalizing unit and the linear matrix calculator 57 are constructed with a total of 
nine look-up tables 64 60 72 and three adders 3, 74 and 75", column 9, line 25-30). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Oku into Ijntema because Ijntema 
discloses a system for color correction with matrix for color compensation and Oku 
discloses the matrix used for color compensation can be constructed with a plurality of 
look-up table and adders in order to accelerate the processing speed. 
1 5. As per claims 2 and 9, Ijntema and Oku demonstrated all the elements as 
applied to the rejection of independent claims 1 and 8, supra, respectively, and Ijentema 
further discloses the plurality of linearization tables comprises three linearization tables 
(since Ijntema discloses in Figure 1 amplifiers for each of red, green and blue colors, 
Ar, A g and A B , and "The characteristics could be stored in a LUT", column 2, line 59), 
the set of pre-calculated gamut shifting arrays comprises three pre-calculated gamut 
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shifting arrays ("a transformation of the RGB signals with a 3x3 matrix can be done", 
column 2, line 34 ), the plurality of non-linearization tables comprises three non- 
linearization tables, and the plurality of constituent colors comprises three constituent 
colors (since Ijntema discloses the amplifiers is used for each of red, green and blue 
colors, it is inherent that they are the three constituent colors and since the linearization 
table is generated for each of the three colors, it is inherent that non-linearization table 
is generated for each of the thee colors). 

Oku further discloses "the plurality of a set of pre-calculated gamut shifting arrays 
comprises nine pre-calculated gamut shifting arrays" (Figure 7 A and Figure 9; 'the three 
look-up tables 61, 62 and 63 of the input normalizing unit and the linear matrix 
calculator 57 are constructed with a total of nine look-up tables 64 60 72", column 9, line 
25-30). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Oku into Ijntema because Ijntema 
discloses a system for color correction with matrix for color compensation and Oku 
discloses the matrix used for color compensation can be constructed with a plurality of 
look-up table and adders in order to accelerate the processing speed. 

16. Claims 3 and 1 1 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ijntema et al. (6,285,350) and Oku et al. (5,489,996) as applied to claim 1 above, and 
further in view of Wilt et al. (US 2002/0085015). 

17. As per claims 3 and 1 1 , Ijntema and Oku demonstrated all the elements as 
applied to the rejection of independent claims 1 and 8, supra, respectively. 
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Ijntema and Oku disclose a system of color correction for a CRT. It is noted that 
Ijntema and Oku do not explicitly disclose the CRT (which is a non-linear display device) 
has sRGB color space, however, this is known in the art as taught by Wilt et al., 
hereinafter Wilt. Wilt discloses a color convertion method using non-linear sRGB color 
space ([0005]). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Wilt into Ijntema and Oku because 
Ijntema and Oku disclose a system of correcting color relating to a CRT (which has non- 
linear color space) and Wilt discloses a color correcting system using non-linear sRGB 
space in order to extend the correction method to displays, scanners and digital 
cameras ([0005]). 

1 8. As per claims 5 and 14, Ijntema and Oku demonstrated all the elements as 
applied to the rejection of independent claims 1 and 8, supra, respectively. 

Ijntema discloses a system of correcting color with a graphics controller (Figure 1 
C). The controller can use look-up table for processing ("The characteristics could be 
stored in a LUT', column 2, line 59). It is noted that Ijentema does not explicitly disclose 
a graphics controller coupled to the plurality of pre-calculated gamut shifting arrays, 
however, this is known in the art as taught by Oku. Oku discloses a color correcting 
system in which the color adjusting matrix is built with a plurality of look-up tables ("The 
hardware of the first color correction unit may be constructed as shown in FIG. 9. As 
shown, the three look-up tables 61 , 62 and 63 of the input normalizing unit and the 
linear matrix calculator 57 are constructed with a total of nine look-up tables 64 60 72", 
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column 9, line 25-30), wherein compensation for color point data through utilization of 
the plurality of pre-calculated gamut shifting arrays is performed at the full processing 
speed of the graphics controller (since the LUT table is used instead of multiplication 
operations, the gamut shifting arrays is performed at the full processing speed of the 
graphics controller). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Oku into Ijntema because Ijntema 
discloses a system for color correction with matrix for color compensation and Oku 
discloses the matrix used for color compensation can be constructed with a plurality of 
look-up table and adders in order to accelerate the processing speed. 

19. As per claims 7 and 13, Ijntema and Oku demonstrated all the elements as 
applied to the rejection of independent claims 1 and 8, supra, respectively, and Ijntema 
further discloses the non-linearities of the color monitor comprise an input-output 
characteristic for each constituent color of the color monitor ("The characteristics could 
be stored in a LUT", column 2, line 59, where the characteristics is the characteristics of 
the monitor). 

20. Claims 6 and 10 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ijntema et al. (6,285,350) and Oku et al. (5,489,996) as applied to claim 1 above, and 
further in view of Shelton (US 2002/0161803). 

As per claims 6 and 10, Ijntema and Oku demonstrated all the elements as 
applied to the rejection of independent claims 1 and 8, supra, respectively. 
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Ijntema discloses a system of color correction which could be applied to TV sets 
and computer monitors (column 3, line 18-19). It is noted that Ijntema does not explicitly 
disclose the input color video data is input from a website, however, this is known in the 
art as taught by Shelton. Shelton discloses a color correction method in which color 
data can be transmitted from a website (Figure 2 18). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Shelton into Ijntema and Oku 
because Ijntema and Oku disclose a system of color correction a pluralities of monitor 
and Shelton discloses the color data could be transmitted from a website in order to 
correct a plurality of remotely located monitor. 

21 . Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over Ijntema 
et al. (6,285,350) as applied to claim 15 above, and further in view of Shelton (US 
2002/0161803). 

As per claim 16, Ijntema demonstrated all the elements as applied to the 
rejection of independent claim 1 , supra. 

Ijntema discloses a method of color correction which could be applied to TV sets 
and computer monitors (column 3, line 18-19). It is noted that Ijntema does not explicitly 
disclose the input color video data is input from a website, however, this is known in the 
art as taught by Shelton. Shelton discloses a color correction method in which color 
data can be transmitted from a website (Figure 2 18). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Shelton into Ijntema because Ijntema 
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discloses a method of color correction a pluralities of monitor and Shelton discloses the 
color data could be transmitted from a website in order to correct a plurality of remotely 
located monitor. 

22. Claim 17 is rejected under 35 U.S.C. 103(a) as being unpatentable over Ijntema 
et al. (6,285,350) as applied to claim 15 above, and further in view of Wilt et al. (US 
2002/0085015). 

As per claim 17, Ijntema demonstrated all the elements as applied to the 
rejection of independent claim 15, supra. 

Ijntema discloses a method of color correction for a CRT. It is noted that Ijntema 
does not explicitly disclose the CRT (which is a non-linear display device) has sRGB 
color space, however, this is known in the art as taught by Wilt et al., hereinafter Wilt. 
Wilt discloses a color convertion method using non-linear sRGB color space ([0005]). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Wilt into Ijntema because Ijntema 
disclose a method of correcting color relating to a CRT (which has non-linear color 
space) and Wilt discloses a color correcting method using non-linear sRGB space in 
order to extend the correction method to displays, scanners and digital cameras 
([0005]). 

Response to Arguments 

23. Applicant's arguments filed 8/23/2004 have been fully considered but they are 
not persuasive. 



Application/Control Number: 09/893,396 Page 15 

Art Unit: 2672 

As per claim 15 and 19, applicant alleges Ijntema does not teach the use of a 
plurality of pre-calculated gamut shifting arrays corresponding to a multiplication look-up 
table (MLUT) comprising pre-calculated values that represent specific multiplication 
operations. In reply, examiner notes in applicant's specification states "The set of 
MLUTs 204-220, and more generally, the 3x3 gamut shifting array or matrix, function to 
transform the color point data from one color space ... to a color space that is specific to 
the monitor 124", [0023] line 1-3. Thus, a matrix has the properties the applicant 
claimed. 

As per claims 1-14 and 16-18, applicant alleges since Ljntema does not satisfy 
limitations as discussed above, therefore, 35 USC 103 rejection is defective. In reply, 
examiner considers Ijntema satisfies claimed limitations. 

As per claims 20-21 and 23-25, applicant alleges Oku does not teach "a plurality 
of multiplication look-up tables (MLUTs) associated with a plurality of pre-calculated 
gamut shifting arrays to compensate for color point data at substantially full video rate". 
In rely, examiner considers "The input data normalizing unit 56 receives the image data 
from the host computer, and converts them into R, G, and B data each consisting of 
eight bits, through gradation converting tables LUT1-1 61, LUT1-2 62, and LUT1-3 63", 
column 7, line 33-37; "The color adjustment unit 57 matrix-calculates the output data Ri 
(58), Gi (59), and Bi (60), thereby to execute the color adjustment", column 8, line 1-3, 
where the matrix operation has multiplication process, therefore, the LUT Is a MLUT. 
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Conclusion 



24. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 



25. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ryan R Yang whose telephone number is (703) 308- 
6133. The examiner can normally be reached on M-F 9:30AM-6:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on (703) 305-4713. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 



Inquiries 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Ryan Yang 
December 16, 2004 




